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Um.  square  «t  las  tore  are  eoaatrueted  for  tfee  slop**,  «wi  3^, 
lr*~*  •v*'ui  ^  and  Ujj,  ana  point  if  intersection,  X*,  of  two  straight.  line*. 

In  com i«uctlua  tb*  -»f  aatcra  the  reeidual  sue  of  squares,  S*,  t*  aistwised 
*n  three  >U|M,  We  aeste»  thet  X^<Xg«.  ♦••<  are  independent  variables  with 
the  corresponding  dependent  variable*  related  to  the  x  *»  bv 

Ki  *  V*lXi  i?  xi  1  X* 


Wx 


if  xi  >  ** 


Tbe  least  squares  estiaatsrs  ig,  X*  are  found  to  satisx* 


Sa^Va2,0l,P2'X*)  -  nin  inf  inf  l  £  a 

i«V*,n-l  Xi<z<X1+1  J-l  *  ^  11 

+  =  ,  (VV^i>^ 

J».TC*)+3.  1  *  *  1 


?(=) 


where  J(z)  »  largest  integer  J  such  that  X  <z. 
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’If- 5  v-  -4 


a***  kriMocJc  or  tvc  inrmiotcTa*a  lueu 

J.  H.  aiuchte  S#pt«*to«r,  iX 


i..  »c*t.  swiaard  w'  Uvs  method  of  Itus  squsLref ,  the  estimators 

-d-.-h  "ir.t  ;«*  the  t*<'^  .*’  •‘i*  <~f  squares  are  easily  eoepuled  es  solution,  of  a 
i*.-t  -f  3 irultanecsus  ii.*ar  cqua. ions.  Thio  i*  not.  the  case  when  constructing 
estir-atcrii  for  the  slopes,  Intercept*  and  point  of  inter* senior,  of  tve  intertect- 
i'-g  lines,  fhe  purpose  ~f  this  .v,te  is  tc  exhibit  the  sasevbat.  »ore  complicated 
minicine.tian  procedure  which  cu^.t  be  used  in  this  case.  The  result*  below  are 
c\  identiy  not  new,  though  the  author  has  been  unable  to  find  a  discussion  cf  this 
particular  problem  in  the  literature. 

R.  E.  Quandt  (iy?1:  and  i960)  discusses  a  similar  estimation  problem  in  vhich 
the  two  recession  lines  ere  not  required  to  intersect  as  well  as  teste  (assuming 
that  the  deviations  from  regression  are  normally  distributed)  of  the  hypothesis 
tnat  the  two  regress  ion  lines  are,  in  fact,  the  same.  E.  5.  Page  (1955  and  1957) 
discusses  a  non-par ametric  test  of  this  hypothesis. 

The  problem  under  consideration  here  is  as  follows;  Suppose  X Xg<  •*•< 
are  a  set  of  independent  variables  and  Y^,»*»,Yn  corresponding  chance  variables 
related  to  the  X,‘s  bv 

X 

EYiI°l+^lXi  if  Xj  <  X  • 

■CZ2+02Xi  if  X±  >  X  ■ 


where  and  X** (a^-Oh, )/ (p^-d^ ) •  We  vi3n  to  compute  least  squares  estimators 

cf  a2,  3^,  p2  and  X",  i.e.,  we  wish  to  find  those  numbers  0^,  a g,  3^  3^  and 


J(X) 


1=3.  J.=Jp  ;+l 


where  J(X'  )  »  the  largest  integer  J  such  tue.t  X  .  <  X  is  a  minimum.  Note  that  we 

O  ** 

cannot  simply  differentiate  vith  -aspect  to  the  five  parameters  since  Zz  is  not 
a  differentiable  function  of  X-. 
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3*  it  niniaised  i:  three  stages  as  fcllcvs.  '.oppose  first  that  /.  •  lu  kr.cv-. 

^  ^  « 

--.  .upite  least  squarr-  5itic«*tors  cf  toe  reaching  paiaaetars,  say  c^,  Ct£,  o  , 
ami  S2  is  ainiaited  subject  to  the  restriction  that  (a*-5| To 
do  this  -  j  dliferentiate  .;?+ Xfc^-O--^*^)*  ■  Jvitb  respect  Xr  a^,  ct^,  C^,  P5 
and  X  rad  equatr  tero.  This  results  in  the  e<juations 


m 

0 

«*€l(Y  -a'-hJX  )+  X 

1  1  1  A 1 

(8) 

r> 

O 

a 

«  -2  E(Y,-£»-£*X  x 

Jtl  *  2  2  i 

(3) 

o 

=  -2E(Yi-ai-d»Xs)Xi+Xy- 

(M 

0 

n  «  a 

*  -2  r(Y,-c*-G»x, 

j*i  -  *  *  ' 

(5) 

0 

A  A  A  A 

=  a^4{3*-e*));- 

where  J=J (>'. • ') ,  Equations  (l), (j)  are  readily  solved,  yielding  the  estimators 
(6)  p*  =  d"1  ^ [lu^y^+Kfy, -y2 ) (x3 '■')  J  [2x|+K(xg-X  )2] 

*'  {T-^^(v2-y^  ( VX  : }  3  <VX  *]  *>} 


(7) 


(3) 

(9) 


r  . 


$1  =  B"~  l  Luu;2y2+K(J'?-y1)(>£-X  ::j]  f&sJ+K^-X  -j] 
+K[i:,y1+K(y1-y0)(x1-A': )]  (xj-X  )(x2-X:')] 


%-rzr.) 

*2~.\  ■  ' 


(  Einy. 


~2J2 

n-J 


Exf 

+y2(:'2-X  •  }-  [~  +x2(x2-X  •■)] 3^  | 


£»  =  a*+(p*4’{)X;: 


where 

K  .  J(n-J) 
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«  x  0:. -xj? 
1  i-i  1  1 


I  Y. 
i=l  * 


V.  =  - - 

J.  J 


Zxlyl  ~  1 


i»J+i 

E-J  ' 


etv. ,,  and 


D  =  fcy^+K(x1-X  '  )2]  ^|+K(x2-X  ]-  [k(£?  -X  ”)  )]  2 

Using  the  estimators  of  equations  (6), ••*,(9)  we  find  the  minimum  residual  sum  of 
squares  given  X to  be 

-  '**  '  -i  •'a 

-  j  K  [b- (Xg-x  '••)  (ZxlJ'^bgC^-X  • )  (Sx2)'1]2Zx^Z;| 
+b1ib^+b2Z:^+2K  to1(x1-X''J-b2(i;-r'  )3(y1-yg) 

-K^-yp)2;  T  jl+KtC^-r  )a(Zr|)”1 
+  ("2-X  )a(Zx|)'a3j 
=  2;/f-rZ>|-91(X”)/Q2(x)  , 

•ay,  where  Cy  and  ars  quadratic  functions  cf  X'-,  and  b^Zx^ya/lx?. 
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The  second  step  in  the  minimization  procedure  is  to  suppose  that  J  is  known,, 
that  is,  that  it  is  knovm  only  .hat  XT<F< X  T, , ,  and  to  find  the  least  squares 

A,  ^  A.. 

estimator  of  X**,  say  X'  * ,  under  this  restriction#  Thus  we  must  find  X'**  satisfying 

S2(X:;« )  =  xru  S2(z) 

X j  <  z  <  J+l 


inf  Llyj+iJ^-Q1(z)/Q2(z)3 


XJ<Z<XJ+1 


=  Syf+  y2-  sup  [Q1(z)/Qp(z)] 


XX  z< X _  - ' 
u  J+x 


In  order  to  determine  X:‘‘,  ve  proceed  as  follows.  Urite 


Q  (z)  =  r<z2+s..z+t,  (i=l,2) 

•L  <i  x  X 


and  consider  the  ratio  d.^(z)/Q^(z)  as  a  function  of  ze(-cc,oo).  Note  that 
d  Ql^2)  (r2Za+'-22+t2)(2r1z+s1)-(riZ2+s1z+t1)(2r2z+s2) 

(^0)  _»  /_*r  -  7T  r, “TZ  T5""  =  0 


dz  Q^Czl 


(rgZ^+SgZ-rtg/' 


is  satisfied  at  +  oo  and  at  the  two  roots,  say  z.  and  z0,  of  the  equation 

X  4— 


(r.s_-s.r„)z2+2(r,t  - t  ro)z+(s.to-t1so}=0  . 

J-wXci  x  d  x  c.  1  c  X  C 


Now  since  Qg(z)  >0  rcr  all  z,  the  roots  t  co  are  asymptotes  of  the  cirve  Q-j/Qg. 


y.  -b.x, -yn+b_x_ 
1  1  1  J2  c: 

Vbl 


z2 »  { [(Ex?r1-t-{zx2)"1]  [  (h^y  £x2/dx|  +b2xlsjizq/Lx?y 


f2  Cb.  )  (y^  -y2 My^y,,  )2  ] 


i 


rr  'm'~ 


-  Kb  1yac*/2x|  +b2ylx|/^)2 

T  |[(!>^)"1+{2x|)  "1]  [b^Lx2  (Ex| )“1+b|^1£x| (Zx£ ) _;L 
+b]b2  +5^ )+ (b1-b2 )  (y1-y2 )  ] 

-[x1(2>:^)"J'+i<2(Zi,:|)“13  [b1 72x2/Ex|+b2  jTx*/Zi^}z  j  -zx  , 

at  one  of  whicb  the  ratio  i  a  maximum  and  at  the  other  of  which  it  is  a  minimum. 
(This  follows  from  the  fact  sat  and  Qg  are  both  polynomials  of  even  degree  so 
that  the  asymptotes  at  +  oo  and  -  co  are  identical.  Hence  Cl,  /Q.  cannot  have  local 
maxima  at  both  z.,  and  z2,  3ince  otherwise  there  would  exist  a  point  with 
zl<z3<z2  at  which  the  curve  would  be  a  local  minimum.  But  then  yhe  derivative 
or  Q,  /0^  would  be  zero  at  z,.  contradicting  the  fact  tha*  z,  and  are  the  only 

x  a  y  -  id 

finite  roots  of  equation  (10).  Similarly  Qj/Qg  carir:ot  have  local  minima  at  both 
z1  and  z2.) 

To  determine  whether  Sa(z2)  or  S2(z5)  is  the  minimum  sum  of  squares,  note 

that 

r,z2+s1z+t1 

.  r„z2+sr.z+tn  r„  * 

J.CX/  c.  d  d  d 

so  that  the  value  of  S2(z )  at  -.he  asymptotes  is 


lim  S2(z)-Sy?+2/2- 
z  — >=oo 


4  2^  +Kb!  E?f  +2KblbS 


K  .  K 
735  T 


““•r  “2-  hxj+2x| 


But  the  reduction  in  sum  of  squares  at  z1  is 

(Zx^)2  (r^yg  )2  (Lx^+Zx^)2 

Ex^  +  >  Zxl+Zx2 


-o- 


i 


Thus  for  fixed  J.  S2(z)  is  a  minimum  in  (-o o,oc)  at  z=z. . 

Hence  by  the  nature  of  the  carve  Q^zJ/Q^z),  if  consideration  is  restricted 
to  zeO:,.,Xj+1),  then  S2(z)  takes  on  its  minimum  value  at  z^yj-bjX^-yg+bgXg)/ (bg-b^) 


‘  -LI.  -•  _ _ J _ l.  .•  .  J  _  O.Vs  „ 

±  i.  UllXCj  lAJJLli  h>  in  ju  uiiv« 


c  interval  (X _,X T  . }  and  at  either  X,  or  XT.,  if  not, 

J  J+l  O  O  TJ. 


a,  x  ,.2,yrVry2i'b2x2x  4J  „  ^ji  t/ri"j,2,^2' 


inf  S2(z)^2C 


y)-b.1x..~y0+b0x!:i 


XJ<Z<XJ+1 


,  ,  -)  if  X.<-  v  . 

b2-b1  J  Vbl 


-<  X 


J+l 


=  min  [s2(Xj),S2  XJ+1)  ]  otherwise. 

The  final  step  in  the  minimization  procedure  is  to  let  J  vary  and  minimize 
over  the  intervals  (XT,XJ+1).  This  minimization  must  be  over  J=l, •••,n-i,  the 
values  1  and  (u-l)  being  included  to  take  into  consideration  the  possibility 
that  X~<  X?  or  X*>X  ..  (in  which  case  estimators  are  obtained  for  only  one  of 
the  lines).  Thus  the  least  squares  estimators  a^,  a^,  *1>  P2»  X~  satisfy 


min  inf  inf  [  E(x  -u.  -p,X,  )2+  Z  (Y.-o^-BpX  )2] 

i<  J<  n-i  <x*<xJ+1  U1  A  X  X  *-iJ+:L  " 


J(X*) 


n 


-  Z  (Y.-O.-P.X  )2+  E  ( t  -^p-PpX,  )* 
i=l  1  1  1  1  j(X*)rl  1  2  Z 1 


The  above  results  now  enable  us  to  write  the  solution  in  a  relatively  simple 
form.  Denote 

1  J  _  a 
x,  ,  =  4  EX.  ,  X.  ,  ~  EX, 

J  i  1  ^  n"J  T+l  i 


yl,J  =  J  ^Yi  ’  y2,J  =  n-J 

J 

^xi-^i,j)(Vyi,j) 


l.J  '  J 

v  ('• 

1  j ' 


J=2,***,n -1 


ai,i+bi,ri  a  Yi 


J=2, •••,n-l 


2(X  )(Y  -y  ) 

J+l  A  *>J  ' 


U2,J 


J=l, ••»,n-2 


A'W' 

J+i 


>2 


®2,J  =  y2,j'b2,  A,J  Jil>***'n*2 


arc 


2  r»— _  ^T! 


S2  ^  g2(J^Ll£jti)  if 

J  S.J-V 


e  [xj»xj+i3 

b2,j’b2,J  J  J+1 


min  (jS2(Xj),32(XJsl)]  otherwise 


<?a 


for  J=2, •••,n-2,  with 

a 
Z 

i=2 

n-1 
£(' 
1=1 


*  =  L(Y<-y0  .  2(X.-^p  ,)2 

x  i=2  -  2,1  2,1  i=2  i  2,1 

Sn-1  =  i^Ti*^l,n-l^a“bl,n-l  i^Xi"Xl,n-l'r 

A  A  A  A  A 

The  solution  is  then  chose  numbers  Q^,  a tg,  g^,  gg,  X  such  that 

s2&,a  ,g  ,g2,::~)  =  an  s? 

1  a  1  i=l, ••*,n-l  ' 

(Note  that  both  lines  are  estimated  only  if 

min  3?  =  mir.  32  .) 
i=l, •**,n~l  i=2,***,n-2 


This  procedure  may  cc.  applied  directly  to  compute  least  squares  estimators  for 
two  intersecting  polynomials  (of  the  same  or  differing  degree),  two  non-inter¬ 
secting  polynomials  (Cf .  Quandt,  1953)?  or,  in  fact,  many  intersecting  or  non¬ 
intersecting  polynomials  in  any  sort  of  combination.  The  calculations  required 
in  i-.hGs**  C3£6s  Brecon!*?  successively  ocs^lsx* 

It  has  not  been  possible  to  determine  the  properties  of  the  abc"*  estimators 
when  all  parameters  are  unknown.  If  the  deviations  from  the  true  regression  are 
assumed  to  be  normally  distributed  with  cannon  variance  aa,  however,  the  above 
lease  squares  cotiiualors  are  maximum  likelihood  and  the  residual  mean  square  is 
the  maximum  likelihood  estimator  of  a2.  Though  exact  variances  of  the  above 
estimators  have  not  been  obtained,  conditional  variances  and  covariances  given 
X  *  are  easily  computed  since  the  estimators  in  the  conditional  case  (given  in 
equations  (6), ••*,($))  are  linear  functions  of  Y^, ***,Yn.  Estimates  of  these 
conditional  variances  and  covariances  can  be  constructed  in  the  usual  way  using 
the  "pooled"  residual  sum  of  squares  minimized  above.  One  is  tempted  to  use  these 
estimates  also  in  the  unconditional  case. 
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